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SUMMARY 


The  steady-state  behavior  of  the  adaptive  line  enhancer  (ALE)  is  analyzed  for 
stationary  inputs  consisting  of  finite  bandwidth  signals  embedded  in  a  white  Gaussian  noise 
(WGN)  background.  Analytic  expressions  for  the  weights  and  output  of  the  LMS  adaptive 
filter  are  derived  as  functions  of  input  signal  bandwidth  and  SNR,  as  well  as  ALE  length  and 
bulk  delay.  The  steady-state  gain  in  broadband  SNR  from  input  to  output  is  derived  as  a 
function  of  these  same  four  variables.  For  fixed  ALE  parameters  and  input  SNR,  it  is 
shown  that  this  gain  increases  as  the  input  signal  becomes  narrower  and  approaches  the 
sinusoidal  limit.  It  is  emphasized  that  because  the  correlation  time  of  finite  bandwidth 
signals  is  limited,  excessively  large  values  of  the  ALE  bulk  delay  parameter  result  in 
diminished  gain.  Furthermore,  there  is  an  optimal  filter  length,  whose  value  depends  upon 
signal  bandwidth  and  SNR,  for  which  the  broadband  gain  is  maximized.  These  results 
demonstrate  the  importance  of  including  the  effects  of  algorithm  noise  in  analyzing  the 
performance  of  real-time  adaptive  processors. 
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1.0 


INTRODUCTION 


Adaptive  digital  filtering  techniques  have  been  shown  to  be 
effective  in  a  wide  range  of  practical  applications  where  there  is  insuffi¬ 
cient  a  priori  knowledge  of  the  expected  signal  and  noise  parameters  to 
design  optimal  fixed  filters.  The  increased  computational  speed  and  per¬ 
formance  capabilities  of  modern  digital  hardware  has  made  it  possible  to 
apply  adaptive  filtering  techniques  in  a  wide  range  of  applications  in 
recent  years.  Representative  applications  include  noise  cancellation  (  1], 
bioengineering  (1],  echo  cancellation  (2,3],  data  equalization  [4-6], 
predictive  deconvolution  [7],  instantaneous  frequency  tracking  [8-101, 
speech  processing  [1.11-13J,  environmental  prediction  [14],  intrusion 
detection  [15,16],  beamforming  [17-19],  radar  clutter  rejection  [20], 
data  communications  [21,22],  systems  identification  [23,24],  narrowband 
signal  enhancement  [1,10,25-27],  narrowband  signal  detection  [28,29], 
coherence  detection  [30],  spectral  estimation  [25,31,32],  and  narrowband 
interference  rejection  ]  33]  . 

Many  of  the  above  applications  employ  external  noise  references 
to  remove  noise  contamination  from  a  desired  signal  as  discussed  in  [I]. 

In  applications  where  an  external  reference  for  the  additive  noise  is  not 
available,  the  interfering  noise  may  be  suppressed  using  a  Wiener 
linear  prediction  filter  (LPF)  if  there  is  a  significant  difference  in  the 
bandwidth  of  the  signal  and  the  additive  noise  [1,25-33).  As  discussed 
in  the  above  references,  a  variety  of  adaptive  estimation  techniques 
have  been  employed  to  provide  time-varying  estimates  of  the  Wiener 
filter  coefficients.  These  include  finite  impulse  response  (FIR),  infinite 
impulse  response  (HR),  and  adaptive  lattice  algorithms.  The  estima¬ 
tion  technique  which  is  most  commonly  employed  in  real-time  applica¬ 
tions  is  the  Widrow-Hoff  beast  Mean  Squares  (LMS)  adaptive  algorithm. 

(In  fact,  echo  cancellers  which  utilize  a  128  tap  LMS  FIR  digital  adaptive 
filter  are  now  being  produced  on  a  single  silicon  integrated  circuit  chip  [34]). 
In  this  paper,  the  steady-state  performance  of  an  adaptive  LPF  which 
employs  the  LMS  adaptive  algorithm  to  estimate  the  Wiener  filter  coefficients 
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will  be  analyzed  under  specified  stationary  input  conditions.  This 
implementation  is  the  adaptive  line  enhancer  (ALE)  which  is  discussed 
in  references  (1,10,25-33).  As  indicated  in  Figure  1,  the  ALE  is  a 
digital  A -step  linear  prediction  filter  for  which  f  is  the  sample  rate, 

L  is  the  number  of  adaptive  weights,  and  A  is  a  bulk  delay  of  an 
integral  number  of  samples.  For  narrowband  enhancement  applications, 
the  output  is  r(k)  ,  and  A  is  chosen  to  optimize  the  frequency  resolution 
as  discussed  in  (25,31,32).  In  the  case  of  finite  bandwidth  signals  in 
correlated  noise,  A  is  selected  so  as  to  suppress  the  additive  noise 
without  causing  significant  signal  attenuation  [  35|  . 

References  (1-33)  contain  a  variety  of  applications  of  adaptive 
Wiener  LPFs.  As  discussed  in  [23],  the  accuracy  of  FIR  system  identi¬ 
fication  methods  is  dependent  upon  the  input  signal  to  noise  ratio  (SNR) 
and  the  bandwidth  of  the  input  signal  (s)  of  interest.  Effective  utiliza¬ 
tion  of  adaptive  LPF  techniques  for  single  reference  noise  suppression 
applications  requires  knowledge  of  the  values  of  A  and  L  that  maximize 
noise  suppression  without  appreciable  signal  distortion.  The  elimination 
of  signal  distortion  is  particularly  important  for  the  application  of  LPF 
methods  to  speech  enhancement  (12,13),  system  identification  |  23,24), 
and  other  applications  described  in  (1-33).  It  was  shown  in  (25)  that 
the  LPF  produces  an  intrinsic  amplitude  distortion  which  is  a  function 
of  the  input  SNR  for  sinusoidal  signals  embedded  in  uncorrelated  noise. 
The  gain  in  output  SNR  of  the  ALE  relative  to  that  of  the  input  was 
shown  to  be  dependent  on  the  input  SNR  and  is  limited  by  the  algorithm 
noise  of  the  LMS  estimation  algorithm  [26].  It  was  demonstrated  in  [29) 
that  the  statistical  properties  of  the  input  are  significantly  altered  by 
the  ALE. 


* 

By  using  the  error  signal  c(k)  as  the  output  of  the  device,  the 
ALE  can  also  be  applied  to  the  suppression  of  narrowband  interfer¬ 
ence  from  broadband  signals  of  interest. 
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Figure  1.  Block  diagram  of  the  ALE  where  weights  wj(k)  are  updated  : 

with  the  Widrow-Hoff  algorithm  w.(k+l)  =  w  (k)  +  2ye(k)  x(k 


In  this  paper  we  will  extend  the  results  obtained  in  |  25,261  to 
derive  analytical  expressions  for  the  impulse  response  and  transfer  func¬ 
tion  of  a  Wiener  LPF  and  for  the  output  power  spectral  density  of  the  ALE 
for  an  input  signal  composed  of  one  or  more  stationary  narrowband  signals 
in  white  Gaussian  noise  (WGN).  These  signals  consist  of  WGN  passed 
through  a  filter  whose  bandwidth  •<  is  quite  small  relative  to  the  Nyquist 
frequency,  but  generally  comparable  to  the  bin  width  1/L.  Analytical 
expressions  for  the  LPF  impulse  response  and  transfer  function  will  be 
developed  assuming  a  stationary  input  sequence  x(k)  whose  autocor¬ 
relation  function  is  known  exactly  and  has  a  rational  z-transform, 

S  (z).  Under  these  conditions,  the  solution  for  the  FIR  Wiener 
xx 

LPF  impulse  response  may  be  obtained  by  using  the  method  of  unde¬ 
termined  coefficients  to  solve  a  set  of  linear  equations  in  which  the 
dimensionality  is  reduced  from  L  to  a  value  determined  by  the  number 
of  poles  and  zeroes  of  S  (z).  As  discussed  in  136,371,  the  use  of 
methods  such  as  Levinson's  algorithm  provides  efficient  computational 
techniques  for  solving  the  L  dimensional  Wiener  equations  but  requires 
the  number  of  filter  taps  and  the  prediction  distance  to  be  known 
explicitly.  The  formulation  used  in  this  paper  allows  L  and  A  to  be 
treated  as  adjustable  design  parameters  whose  value's  can  be  chosen 
so  as  to  maximize  output  SNR  for  various  input  conditions.  These 
results  illustrate  that  the  Wiener  LPF  will  product'  both  amplitude  and 
bandwidth  distortion  of  the  narrowband  components  of  x(k)  at  the 
filter  output  y(k).  It  will  further  be  shown  that  the  magnitude  of 
this  distortion  is  a  function  of  the  input  SNR,  the  bandwidth  (  x)  of 
the  signal,  and  the  frequency  resolution  (f^/L)  of  the  LPF.  These 
results  reduce  to  those  previously  derived  for  sinusoidal  inputs  in 
[  25)  when  a  =  0. 

The  steady-state  noise  suppression  capabilities  of  the  ALE  will 
be  determined  as  a  function  of  the  input  signal  bandwidth  and  the 
input  SNR  for  a  single  bandlimited  input  in  WGN.  Analytic  expressions 
will  be  derived  which  express  the  impulse  response  and  transfer  func¬ 
tion  of  the  ideal  Wiener  LPF  as  a  function  of  both  filter  parameters  and 
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signal  variables.  Using  a  definition  of  output  SNR  that  considers  con¬ 
tributions  of  both  the  optimal  Wiener  filtei  and  the  m’sadjustment  noise 
of  the  LMS  algorithm,  broadband  gain  will  be  computed  as  a  function  of 
the  ALE  parameters  L,  A,  and  the  feedback  gain  constant  11  ,  as  well 
as  the  input  variables  a  and  SNR.  It  will  be  demonstrated  that  for 
ALE  parameters  and  broadband  input  SNR  fixed,  the  gain  of  the  device 
decreases  as  the  input  signal  bandwidth  increases.  In  addition,  A 
should  not  exceed  1/a,  and  there  is  an  optimal  value  of  L  which  is  a 
function  of  the  input  signal  bandwidth  and  broadband  SNR.  In  the 
limit  as  n  ->  0,  these  results  are  found  to  be  in  agreement  with  those 
of  previous  studies  dealing  with  sinusoidal  signals  embedded  in  a  WGN 
background. 
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2.0 


ALE  WEIGHT-VECTOR  MODEL 


The  basic  properties  of  the  adaptive  line  enhancer  and  its 
operation  are  described  in  [  1 , 25 , 2f>']  .  As  indicated  by  the  block 
diagram  in  Figure  1,  the  ALE  consists  of  an  L-weight  linear  predic¬ 
tion  filter  in  which  the  filter  coefficients,  w.(k),  are  updated  at  the 
input  sampling  rate,  f  .  The  adaptive  filter  output  r(k)  is  defined 
by 


L-l 

r(k)  =  w.(k)  x(k-i-A),  (1) 

i=0 


where  A  is  the  prediction  distance  of  the  filter  measured  in  samples. 
The  output  r(k)  is  then  subtracted  from  the  input  sequence  x(k)  to 
form  an  error  sequence  c(k).  The  error  sequence  is  multiplied  by  a 
scalar  constant,  g  ,  and  fed  back  to  adjust  the  filter  weights  according 
to  the  Widrow-Hoff  LMS  algorithm  [  38] 


w.(k+L)  =  w . ( k )  +  2uc(k)  x(k-i-A)  ,  i  =  0,1 . L-l.  (2) 

Provided  that  the  feedback  constant  ;i  is  strictly  less  than  the  recip¬ 
rocal  of  the  largest  eigenvalue  of  the  input  autocorrelation  matrix,  the 
expected  value  of  the  weight  vector  w(k)  converges  to  the  Wiener 
solution 

*  -  \ 

w  =vd  (3) 

where  <!>  is  the  L*L  input  data  autocorrelation  matrix  with  elements 
t1 ,  .  =  4>  (k-S,)  =  E{x(k)  x ( 9, )  }  and  d  is  a  vector  of  length  L  with 

components  d^  =  ix(k  +  A). 

As  developed  in  prior  work  [26]  and  depicted  in  Figure  2,  a 
steady-state  model  for  the  converged  ALE  weight  vector  w(k)  = 

[wg(k)  ...  _j(k)|  may  be  obtained  by  decomposing  w(k)  into 

+.  'X. 

two  parallel  weight  vectors  w(k)  =  w  '  +  w(k).  Here,  w*  is  the 
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steady-state  ALE  for  narrowband  signals  in  white  noise. 


optimum  Wiener  A -step  predictor  weight  vector,  and  w(k)  is  a  very 

slowly  fluctuating  vector  random  process  with  a  mean  value  of  zero. 

Under  the  assumptions  of  relatively  slow  adaptation,  low  input  SNR, 

and  white  Gaussian  input  noise,  the  weight  vector  "misadjustment " 

w(k)  is  assumed  to  be  independent  of  the  current  data  in  the  filter. 

Thus,  the  steady-state  weight  vector  may  be  treated  as  a  Gaussian 

2  2 

random  variable  w  with  mean  w*  and  covariance  o  I,  where  o  = 

—  —  w  w 

.  and  £,  .  is  the  minimum  mean  squared  error  associated  with 
min  min 

Wiener  filtering  of  the  input  [1]. 

For  the  equivalent  model  of  the  steady-state  ALE  illustrated  in 
Figure  2,  the  output  r(k)  is  a  superposition  of  the  Wiener  filter  (WF) 
and  misadjustment  filter  (MF)  outputs,  i.e., 

r(k)  =  r*(k)  +  r(k).  (4) 

For  an  input  x(k)  comprised  of  a  signal  and  noise  components,  r(k) 
is  thus  a  sum  of  four  terms — WF  signal,  WF  noise,  MF  signal,  and  MF 
noise.  The  output  SNR  can  be  calculated  as  the  power  in  the  WF 
signal  component  divided  by  the  total  power  contributed  by  the  other 
three  terms.  The  gain  of  the  ALE  can  then  be  found  by  dividing  the 
output  SNR  by  the  input  SNR. 

In  the  sections  that  follow,  a  description  of  the  procedure  used 
to  derive  the  impulse  response  of  an  ideal  Wiener  filter,  w*,  will  be 
given  in  Section  3.1.  These  results  will  then  be  applied  to  obtain  w* 
and  the  Wiener  filter  transfer  function  H*(  .)  for  the  special  case  of  a 
narrowband  input  signal  in  additive  WGN  in  Section  3.2.  The  output 
SNR  gain  of  the  ALE  will  be  defined  and  computed  in  Section  4  as  a 
function  of  input  and  adaptive  filter  parameters. 


3.0 


DETERMINATION  OF  THE  MEAN  LPF  COEFFICIENTS 


3.  1  Generalized  Inputs 

Referring  back  to  Figure  1,  the  LPF  coefficients,  w*(k),  which 
minimize  the  power  in  the  error  sequence  e(k)  ,  satisfy  the  discrete 
form  of  the  Wiener-Hopf  equation. 


L-l 

E*  U-k)  w*(k)  =  *U+A),  £  =  0,1 . L-l.  (5) 

xx  xx 

k=0 

The  series  <b  (£)  =  El  x(k)  x(k+  £)  ]  ,  where  the  overbar  denotes  complex 
xx 

conjugation,  is  the  autocorrelation  of  the  stationary  input  x(k).  The  set 
of  L  linear  equations  described  by  Equation  (5)  can  be  solved  by  elementary 
methods  if  the  z-transform  of  4>  x(£), 

00 

Sxx<*>  ;  E  »„«‘l  *'*• 

£=-“> 


is  a  rational  function  of  z  [  35]  .  The  assumption  of  stationarity  means 


that  S  (z)  =  Sxj,(l/z)  for  all  complex  values  of  z,  and  therefore 


Sxx(z)  =  H(z)H(l/z)  =  K  p 


azi _ 

P=1 


(6) 


where  K,  a  ,  6  are  positive  real  constants,  and  w  ,  ip  lie  in  the  closed 
P  q  p  q 

interval  [  —  it  ,  tt  J .  Thus,  Sxx(z)  is  characterized  by  P  pairs  of  poles  at 

z  =  exp(±i  +j:t.  )  and  Q  pairs  of  zeroes  at  z  =  exp(±iy+jijj  ).  The  expansion 

r  p  p  9  CJ 

in  Equation  (6)  with  z  =  exp(joi)  represents  the  power  spectrum  of  a  complex 

process.  For  a  real  process,  any  complex  poles  and  zeroes  of  S^(z)  will 

appear  in  quadruplet  sets  because  of  the  presence  of  conjugate  pairs  at 

z  =  exp(±  «  -joi  )  and  z  =  exp(±B  -jip  ). 

1  o  J  p  q  q 
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The  general  form  for  the  solution  to  Equation  (5)  for  stationary 

inputs  with  rational  power  spectra  such  as  that  described  by  Equation  (6) 

is  derived  in  [35].  In  the  case  where  number  of  zeroes  of  S  (z)  does 

xx 

not  exceed  the  number  of  poles  (Q  <_  P)  ,  the  LPF  coefficients  can  be 
expressed  as 


__  (  ~6  k+jty  -f5  (L—  1— k)  +j i|> 

w*(k)  =  ^  |b  eq  q  +  Beq  q 


P-Q  , 

£  j  C+  6(k-r+l) 
r=l  * 


+  Cr  6(k+r-L)  >  ,k  =  0,1 . L-l, 


where  6 ( k )  is  the  Kronecker  delta  function.  Note  that,  in  general, 
w*(k)  consists  of  sums  of  damped  exponentials  as  well  as  impulses. 

The  complex  exponentials  exp(±8  +jij>  )  are  the  zeroes  of  S  (z),  and 

CJ  CJ  XX 

the  amplitudes  of  the  terms  decaying  from  the  beginning  (k=0)  and  end 
( k  =  L  —  1 )  of  the  filter  are  symbolized  by  the  constants  B+  and  B  , 
respectively.  Similarly,  Cr  and  Cr  represent  the  amplitudes  of  impulses 
that  appear  at  k  =  r- 1  and  k  =  L-r  when  P  >  Q.  The  constants  with  a 
"+"  superscript  :an  be  thought  of  as  forward  terms,  while  those  having 
a  are  associated  with  reflection  terms  which  occur  because  of  the 
finite  filter  length  L  [1).  The  values  of  B"  and  C“  can  be  determined 
by  solving  the  set  of  2P  coupled  equations  obtained  from  substituting 
the  expression  for  w*(k)  given  in  Equation  (7)  into  Equation  (5)  pro¬ 
vided  that  <j>  (  i)  is  known  explicitly  [35]. 

XX 


mm 


3-  2  Narrowband  Signals  Embedded  in  WGN 

The  primary  difficulty  in  applying  Equation  (7)  to  obtain  the 
mean  LPF  response  is  that  it  requires  a  pole-zero  model  for  the  LPF 
input  autocorrelation  in  the  form  defined  by  Equation  (6)  [1].  For 
mutually  uncorrelated  narrowband  processes  embedded  in  additive 
broadband  noise, 


*„BI  =  4ss('>  +  V<:) 


<») 


and 


S  (z)  =  S  (z)  +  S  (z)  , 

xx  ss  nn 


(9) 


where  the  signal  transform  S  (z)  and  the  noise  transform  S  (z)  are 

ss  nn 

known  rational  functions  of  the  type  described  by  Equation  (6), 


Although  the  poles  of  Sxx(z)  are  simply  the  sum  of  those  of 

S  (z)  plus  any  contributed  by  S  (z),  its  zeroes  do  not  have  a 
ss  nn 

simple  analytic  form  in  the  general  case.  However,  as  explained  in 
[  35 1  ,  approximate  expressions  for  the  values  6^,  iji  of  Sxx(z)  can 
be  derived  if  Ssg(z)  is  comprised  of  pole  pairs  lying  sufficiently  close 
to  the  unit  circle  that  their  contributions  to  the  total  power  spectrum 
do  not  overlap  appreciably.  Under  these  conditions  of  widely-spaced 
narrowband  signal  processes,  the  background  noise  spectra]  density  can 
be  approximated  by  evaluating  S  (e^)  at  frequencies  away  from  the 
vicinity  of  the  poles  of  Sgs(z).  The  transform  of  the  total  input  is  then 
expressed  as  the  product 


S  (z) 
xx 


S  ( z)  R(z)  , 
nn 


(10) 


where  R(z)  is  a  rational  function  of  z  characterized  by  the  poles  of 


Sgs(z)  and  an  equal  number  of  zeroes  located  on  the  same  radial  lines 


351  .  Equation  (10)  implies  that  when  broadband  noise  having  pairs 


of  poles  and  Qn  pairs  of  zeroes  is  added  to  narrowband  signals  having 


Pg  pole  pairs,  the  total  input  process  may  be  approximated  by  an 
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autoregressive,  moving-average  (ARMA)  model  with  2(Pg+Pn)  poles 
and  2(Pg+Q^)  zeroes. 

The  utility  of  the  general  approach  outlined  above  is  now 
demonstrated  by  consideration  of  a  simple  example.  Assume  that  the 
input  autocorrelation  is  real  and  consists  of  a  finite  bandwidth  signal 
embedded  in  uncorrelated  noise,  i.e.. 


J>  (  £)  =  a2  e  a  ^  cos  id  i  +  v2  6(  i)  , 

xx  o 


where  a  ,  a,  and  represent  the  power,  3  dB  half  bandwidth,  and 
center  frequency  of  the  signal  and  v2  is  the  power  of  the  noise.  1  In 
this  case,  the  z-transform  of  the  narrowband  signal  term, 


Sss(z) 


2/i  2ou 

o  (  1-e  ) 


-a+ju.  - !  '““K  . 

( z-e  ) ( z  -e  )  ( z-e 


j(,;o  -i  a+^o 

)  (z  -e 


has  four  poles  at  exp(±a±jwg).  Noting  that  S^^fz)  =  <j  has  neither  poles 
nor  zeroes  and  using  the  approximation  given  in  Eq.  (10)  valid  for  a  <<  1, 


S  (z)  =  v 

xx 


~6+J*ow  B+jwow 

2  (z-e _ )  (  z-e  )(z-e _ )(z~e  ) 

-a+K  «+j^ow  'a_jw0w  a'ju0, 

(z-e  ) ( z-e  ) ( z-e  )(z-e  ) 


Thus,  the  z-transform  of  the  total  input  has  four  zeroes  located  at 
different  distances  away  from  the  unit  circle,  but  on  the  same  radial 
lines  as  the  signal  poles.  In  terms  of  these  zeroes  at  exp ( iBij'.ip)  ,  the 
LPF  coefficients  for  the  real  input  autocorrelation  designated  in  Equation 
(11)  are  written  in  a  manner  analogous  to  the  general  form  of  Equation 
(7),  i.e., 


r  2  2 

Note  that  because  4>xx(0)  -  0  +v  does  not  depend  upon  a,  it  is  the 
total  energy  in  the  input  spectrum  that  is  held  constant  in  this  model. 


i 


w  *  (  k  ) 


~  1*  k  o  -  i.  (L~  1  -  k )  .  / .  . » 

+  B  t‘  |  cos  .  k+  v)  . 


•]« 


(  I  5' 


The  constants  3.  B  ,  and  B  are  determined  by  substituting  Equations 

(11)  and  (13)  into  (5).  Assuming  the  prediction  distance  A  >  0  and 

neglecting  the  summation  over  non-stationary  cosine  terms  (L  **  1)  ,  the 

resultant  equation  contains  exponential  terms  of  the  form  e  e  ^ ) 

—  ct  ~ "  ot  ( f  t  ”  j 

e  and  e  .  Grouping  terms  of  either  of  the  first  two  of  these 

types  specifies  the  relationship  between  the  zero  and  pole  locations  in  (12) 
to  be 

SNR 


sh  p 


cosh 


sinh 


(14) 


where  a  is  the  input  signal  bandwidth  and  SNR  A  o  /  v  .  As  derived 
in  |  35]  for  a  more  general  case,  the  above  equation  implies  that  for 
poles  and  zeroes  close  to  the  unit  circle, 


/7*(a  +  SNR)  , 


a,  h 


(15) 


This  dependence  of  filter  bandwidth  on  signal  bandwidth  and  broadband 
input  SNR  is  illustrated  graphically  in  Figure  3.  Note  that  the  plot  of  g 
vs.  SNR  for  each  different  value  of  a  can  be  characterized  by  two  linear 
asymptotes.  To  the  left  of  the  breakpoint  at  SNR  =  a,  the  curves  become 
horizontal,  indicating  that  g  ->  a  in  the  limit  of  noise  only  input.  To  the 
right  of  the  breakpoint,  the  filter  bandwidth  may  be  approximated  by 
the  line  b  =  /  iSNR  in  the  logarithmic  plot. 

—  0 [  £ 

Determined  in  a  similar  manner  by  equating  coefficients  in  e 
and  e  ^  ,  the  forward  and  reflection  amplitudes  are: 


o  +  _  2e  aA(  g-a)  (  g+a)  2 

(g+a)2-e'2BL(g-a)2 

and 


B 


2e 


aA(  g+ct)  (  B~  a) 
(g+a)2  -  e'2 


2  -  g(L+l) 
e _ 

(g-a)  2 


a, g  <  <  1 . 


(16a) 


(16b) 


i 
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Equations  (13)  through  (16)  provide  a  complete  description  of  the  solu¬ 
tion  to  the  Wiener-Hopf  equation  for  an  input  consisting  of  a  real  narrow- 
band  process  in  additive  uncorrelated  noise. 


The  frequency  response  of  the  LPF  is  now  determined  as  the 
sum  of  the  transforms  of  the  forward  and  reflection  components  of 
w*  (L  ,  A)  ,  i.e.  , 

L-l  L-l 

H*(u>)  =  B+e  cos  uip(k+A)e  B  e  *  ^^cos  oj^fk+Aje  ^ ^ 

k=0  k=0 


Performing  the  summations  and  taking  the  magnitude-squared  assuming 
no  spectral  overlap  of  positive  and  negative  frequencies, 


|h*(«) 


e 


-B(L-l) 


B  +  B  cosh  13L  -  cos  xL 
2  cosh  6  -  cos  x 


-  + 


B+B 


(coshB  cosx-1)  (coshgL  cosxL-1)  -sinhBsinx  sinhBL  sinxL 

2 

(cosh  8  -  cos  x) 

(17) 


where  the  variable  x  is  used  to  denote  the  frequency  difference  u-Wq. 

The  frequency  response  described  by  Equation  (17)  is  plotted  in 
Figure  4  for  fixed  u,  A,  L,  and  a.  The  tendency  of  the  Wiener  filter 
to  turn  itself  off  in  the  absence  of  correlated  inputs  is  evidenced  by 
the  downward  shift  in  |H*(w)  |  for  decreasing  values  of  input  SNR. 

Note  also  that  the  vertical  bars  marking  the  3  dB  bandwidth  of  the  filter 
appear  at  frequencies  approximately  equal  to  ^  ±  a  for  SNR  <  a,  but 
they  spread  farther  apart  for  higher  SNR.  This  broadening  of  filter 
bandwidth,  already  evident  from  the  plots  of  6  that  appeared  in  Figure 
3,  may  be  interpreted  as  follows:  In  the  low  SNR  case,  the  frequency 
response  of  the  LPF  must  be  narrow  in  order  to  suppress  the  rather 
large  amount  of  noise  power  present  in  the  vicinity  of  the  signal.  As 
the  relative  strength  of  the  signal  increases,  however,  the  transform 
of  the  filter  can  afford  to  widen  in  order  to  respond  to  the  signal  com¬ 
ponents  at  i,i  i-  „'q,  without  passing  significantly  more  noise  power. 
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Unlike  the  filter  bandwidth  B ,  the  amplitude  coefficients  B  + 
and  B  appearing  in  Equation  (13)  depend  upon  the  filter  parameters 
A  and  L  as  well  as  input  SNR.  First,  observe  that  the  values  of 
both  the  forward  and  reflection  amplitudes  given  in  Equation  ( 16)  are 
proportional  to  exp(-cxA).  This  implies  that  for  a  fixed  value  of  a  •>  0, 
the  magnitude  of  w*(k)  diminishes  as  the  input  signal  suffers  greater 
decorrelation  for  increasing  values  of  bulk  delay.  Second,  note  that 
the  contribution  of  the  reflection  term  relative  to  that  of  the  forward 
term  is  dependent  upon  the  filter  length,  i.e.  , 

B”  -B(L+1)  (B-a) 

B+  -  C  (B+a) 

for  <<  1.  Thus,  for  L  >>  1/B,  the  relative  value  of  the  reflection 

term  approaches  zero,  and  w£(L,A)  is  comprised  solely  of  a  damped 
sinusoid  decaying  from  the  beginning  of  the  filter,  in  agreement  with 
the  infinite  length  Wiener  filter  discussed  in  I  39]  . 

There  is  another  limiting  case  of  interest.  Under  conditions 
where  the  filter  length  is  sufficiently  short  relative  to  the  signal  band¬ 
width  that  BL  ->  0  for  all  SNR,  the  input  resembles  a  single  sinusoid 
in  white  noise.  Consideration  of  this  case  is  important  both  as  a  check 
on  the  results  presented  above  and  as  a  means  of  comparing  the  behavior 
of  the  LPF  for  inputs  of  finite  versus  infinitesimal  bandwidths.  Assuming 
that  exp(-gk)  is  approximately  unity  for  all  0  £k  <  L,  the  Wiener  coeffi¬ 
cients  given  in  Equation  (13)  simplify  to 

w  (k)  =  (B+  +  B  )  cos  >iq( k+ A)  ,  BL  <<  1, 

a  constant  times  the  phase-compensated  input  signal.  In  the  limit  as 
BL  >  0,  both  B+  and  B  computed  in  (16)  approach  the  same  value. 

In  terms  of  the  definition  used  in  previous  studies, 

*  ,  L  SNR/2 

a  1  +  L  SNR/2’ 
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the  forward  and  reflection  amplitudes  are  B  =  B  =  exp(-aA)a  / L. 
Therefore,  Equation  (13)  gives 

w*(k)  =  e  cos  w  (k+A)  ,  6L  <<  1, 

which  agrees  with  previous  results  provided  the  delay  A  does  not 
decorrelate  the  signal.  Thus  for  A  <<  a  ,  the  performance  of  the 
LPF  of  length  L  <<  (a  +  aSNR)  2  for  a  finite  bandwidth  signal  in 
white  noise  approaches  that  achieved  for  a  pure  sinusoid  embedded 
in  the  same  broadband  background. 
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4.0  SECOND-ORDER  OUTPUT  STATISTICS  FOR  NARROWBAND 

SIGNALS  IN  WGN 

Recalling  the  weight  vector  model  described  in  Section  2,  the  ALE 
output  for  narrowband  inputs  in  WGN  is  comprised  of  four  additive  com¬ 
ponents:  (I)  Wiener- filtered  (WF)  signal;  (2)  WF  noise;  (  3)  misadjustment 
filtered  (MF)  signal;  and(4)  MF  noise.  The  general  behavior  of  their 
second-order  statistics  is  typified  by  the  power  spectral  densities  dis¬ 
played  in  Figure  5.  Note  from  Figure  5a  that  the  WF  signal  spectrum,  the 
result  of  passing  a  narrowband  input  through  a  narrowband  filter,  exhibits 
sharp  attenuation  for  frequencies  away  from  the  signal  center  frequency. 

The  two  WF  terms  match  at  .  =  ,  ,,  because  S  (  .  )/  S  (  =  SNR/  t 

is  approximately  unity  in  this  particular  example.  For  the  same 
reason,  the  power  spectral  densities  of  the  MF  terms  displayed  in 
Figure  5b  are  also  equal  to  one  another  at  the  center  frequency, 
but  at  a  level  of  more  than  20  dB  lower  than  those  of  the  WF  terms. 

Broadband  gain,  dependent  upon  the  total  power  over  the 
entire  frequency  spectrum,  can  be  calculated  directly  from  the  input 
autocorrelation  given  in  (11)  and  the  convergent  ALE  weight  vector 
described  in  (13).  Representing  the  autocorrelations  of  the  four 
mutually  uncorrelated  components  of  r(k)  as  <$*(£),  <f*(t).  'f  g  (  £ ) ,  and 
j)’n(£),  the  output  SNR  is 

<o°> 

SNR  =  - — - —  .  (18) 

°  4>n  ( 0)  +  *s(0)  +  ?n(0) 

The  sum  of  the  output  autocorrelations  for  the  two  misadjustment  terms 
is 

*(0)  =  3  (0)  +  X  (0)  =  ■  L(o2  +  V2)  (19) 

o  11  [  1 1 i I  1 

where  f.  .  ,  the  minimum  mean-squared  error  associated  with  Wiener 

filtering  of  the  input,  is  approximately  equal  to  for  large  values  of 
L  |3}.  Assuming  a  sufficiently  long  filter  length,  the  WF  noise  com¬ 
ponent  is 
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POWER  SPECTRAL  DENSITY  (dB)  .  POWER  SPECTRAL  D 


Figure 


a.  WF  signal  and  noise  terms. 


5. 


b.  MF  signal  and  noise  terms. 

Power  spectral  densities  of  the  four  ALE  output  components 
the  parameters  u  =  2  A  =  1,  L  =  1024.  t  1/L,  SNR.  -  -  30 
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t  +  (0) 


L-l  L-l 

52  iC  wk  w  [  v 2  ^ 

k=l  8=0 


2  -3L  j(B  )  +  (B~) 


sinh  RL  +  B  B  L  >  , 


(20) 


Using  the  same  assumptions,  the  WF  signal  term  is  evaluated: 


MO) 


L-i  L-l 

££ 

k=0  8=0 


*  *  2  -a  Ik-  8  I  , ,  . 

w^  w  ^  o  e  1  1  cos(k-i')  ..q 


o2e'6L  l(B')  +(B")  r.-.L.  a  -  xL 


„2  2  ) 

S  -a  ( 


cosh  BL  -  —  sinh  SL  -  e 

p 


(21) 


+  B+B 


e  1(8  +  a  )coshBL  4-  2aBsinhBL]  -  (  + a ^ ) 


a  2  2 
6  -  a 


yl. 


Ji 


Broadband  ALE  gain  is  determined  by  the  ratio  of  (21)  divided 
by  the  sum  of  (19)  and  (20)  to  input  SNR.  =  o2/\)2.  The  effects  of 
input  signal  variables  and  filter  parameters  are  illustrated  in  Figures 
6  through  9.  In  all  cases,  the  total  input  power  is  held  constant 
(o  +  v  =  0.04),  and  the  ALE  feedback  parameter  is  also  fixed  (  u  =  2  ^) . 

As  a  demonstration  of  the  result  of  increasing  signal  bandwidth,  broad¬ 
band  gain  is  plotted  as  a  function  of  input  SNR  in  Figure  6  for  =1, 

L  -  1024,  and  a  varying  from  zero  to  16  times  the  ALE  resolution  (1/L). 
Note  from  the  shift  downward  and  to  the  right  that  gain  decreases  for 
increasing  a  and  the  performance  is  most  severely  degraded  at  low  values 
of  input  SNR. 
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1  hi-  effect  of  filter  parameters  L  and  A  is  shown  in  Figure  7. 

In  7a,  gain  vs.  SNR  is  plotted  for  signal  bandwidth  and  filter  length 
ti\ed.  and  bulk  delay  varying  from  unity  to  3  times  L.  As  expected, 

ALE  gain  decreases  exponentially  as  a  function  of  the  product  uA  due 
to  increasing  signal  decorrelation.  The  dependence  of  gain  upon  filter 
length  is  more  complicated,  however.  Note  from  the  crossing  curves  in 
figure  7b  that  for  fixed  a  and  A,  the  value  of  L  yielding  the  maximum 
gain  is  equal  to  or  less  than  the  inverse  signal  bandwidth,  depending 
upon  the  input  SNR. 

In  order  to  demonstrate  the  relationship  between  the  optimum 
filter  length  and  the  input  signal  variables,  broadband  gain  is  plotted 
as  a  function  of  L  for  several  values  of  a  and  SNR  in  Figure  8.  From 
8a,  it  is  obvious  that  for  low  SNR,  the  peak  in  the  gain  curves  for  each 
value  of  a  coincides  with  the  small  vertical  bar  which  marks  the  point 
where  L  =  1/nt.  The  same  is  true  only  for  the  two  lower  curves  in 
Figure  8b,  where  a  >  SNR  s  2  the  optimum  L  for  a  <_  2  ^  is  left 
of  the  1/a  mark.  The  family  of  curves  in  8c  shows  that  for  SNR  >  a, 
gain  is  less  sensitive  to  the  choice  of  L. 

As  turther  clarification  of  ALE  gain  performance  as  a  function  of 
tilter  length,  component  terms  are  plotted  in  Figure  9  for  moderate  and  high 
SNR  conditions.  The  three  curves  displayed  in  each  case  represent  WF 
signal  (  4>s ( 0)  )  ,  WF  noise  (<£^(0))  and  MF  signal  plus  noise  (4>'(  0) ) .  Looking 
first  at  9a,  note  that  4>n  (0)  <  $(0)  for  all  L  and  thus  broadband  noise  at 

the  output  is  dominated  by  the  misadjustment  terms  regardless  of  ALE 
filter  length.  The  <£*(0)  numerator  component  rises  quite  rapidly  with 
increasing  L  and  then  saturates  at  about  L  =  1/6,  the  point  marked  by 
the  small  vertical  bar.  This  explains  why  the  ALE  gain  curve  (a  =  2 
appearing  in  Figure  8b  exhibited  a  maximum  for  that  value  of  L.  The 
component  terms  displayed  in  9b  illustrate  that  for  high  SNR,  the  behavior 
is  not  so  simple.  Although  the  <J>*(0)  shows  the  same  saturation  behavior 
in  the  vicinity  of  L  =  1/6,  the  output  noise  is  not  dominated  by  the  linearly 
increasing  misadjustment  terms  except  for  very  long  filter  lengths  where 
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ALE  FILTER  LEI.uiH  L 

Optimal  filter  length  determination  as  a  function  of  signal 
bandwidth  and  SNR.  (y=2_^3,  A  =  1,  small  vertical  bars 
indicate  L  =  1/a  for  each  curve). 
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BL  >>  1  and  there  are  a  significant  number  of  unused  adaptive  weights 
The  flattened  gain  curve  in  Figure  8c  reflects  the  behavior  of  these 

components . 

I 
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5.0  CONCLUSIONS 


The  steady-state  behavior  of  the  adaptive  line  enhancer  (ALE) 
has  been  analyzed  in  this  paper  for  stationary  inputs  consisting  of 
narrowband  signals  embedded  in  additive  broadband  noise.  The  nar¬ 
rowband  signals  were  modeled  as  the  output  of  a  bandpass  filter  oi 
finite  bandwidth  a,  centered  at  a  specified  frequency  .j^.  Assuming 
non-overlapping  signal  spectra  (a  <<  1  and  0  <<  <*._  <<  tt )  ,  analytic 
expressions  for  the  ALE  weights  and  output  were  derived  as  functions 
of  input  and  adaptive  filter  parameters.  The  steady-state  ALE  has 
been  decomposed  into  two  components:  a  deterministic ,  time-invariant 
Wiener  prediction  filter  (WF)  and  a  slowly-varying,  random  misadjust- 
ment  filter  (MF).  The  relative  contributions  of  these  two  filters  were 
discussed,  and  it  was  shown  that  the  MF  components  can  be  neglected 
only  in  certain  cases  of  high  input  signal-to-noise  ratio  (SNR)  . 

An  appropriate  pole-zero  model  was  defined  which  allowed  the 
WF  solution  to  be  determined  for  an  arbitrary  prediction  distance  (A) 
and  number  of  adaptive  weights  (L) .  It  was  demonstrated  that  the  WF 
takes  the  form  of  a  bandpass  filter  centered  at  frequency  .  q.  The 
bandwidth  ( 8)  of  the  Wiener  filter  was  shown  to  be  a  function  of  input 
SNR  and  signal  bandwidth.  It  was  emphasized  that  the  value  of  S 
exceeds  that  of  a,  except  for  very  low  input  SNR  conditions  where  the 
filter  and  signal  bandwidths  match.  The  general  expressions  for  the 
WF  impulse  response  and  transfer  function  herein  derived  have  been 
simplified  for  two  limiting  cases--one  in  which  the  length  of  the  trans¬ 
verse  adaptive  filter  is  sufficiently  long  that  liL  '•>  1,  and  the  other 

in  which  gL  <  <  I  for  the  input  signal  bandwidth  and  SNR  of  interest. 
The  results  for  this  latter  limit  were  shown  to  agree  with  those  previ¬ 
ously  derived  for  sinusoids  in  WGN  |  26] . 

The  output  of  the  steady-state  ALE  was  modeled  as  the  sum  of 
four  independent  components--one  considered  signal  and  the  other 
three  regarded  as  noise.  The  output  signal  component  corresponds  to 
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the  narrowband  input  filtered  through  the  WF ,  while  the  output  noise 
consists  of  WF  filtered  noise  as  well  as  MF  filtered  signal  and  noise 
terms.  Second-order  statistical  properties  of  these  four  output  com¬ 
ponents  were  derived,  and  an  expression  was  given  for  the  broadband 
ALE  gain,  the  ratio  of  output  SNR  to  that  of  the  input.  For  fixed  ALE 
parameters,  the  gain  of  the  adaptive  filter  was  shown  to  decrease  with 
increasing  input  signal  bandwidth  and/or  diminishing  input  SNR.  In 
the  limit  as  a  approaches  zero,  the  gain  expressions  herein  derived 
reduce  to  those  previously  reported  for  adaptive  enhancement  of  sinu¬ 
soids  in  WGN  [26]. 


The  determination  of  optimal  ALE  length  and  bulk  delay  param¬ 
eters  for  given  input  bandwidth  and  SNR  has  also  been  discsussed  in 
this  paper.  For  the  narrowband  signal  model  used  here,  broadband  ALE 
gain  decreases  approximately  exponentially  as  a  function  of  increasing 
values  of  the  product  x A .  Because  of  this  effect  which  results  from 
decorrelation  of  a  finite  bandwidth  signal,  the  ALE  bulk  delay  should 
not  exceed  1  hi  when  the  input  noise  is  uncorrelated.  The  choice  of 


optimal  filter  length  is  more  complicated  and  depends  upon  input  SNR 
as  well  as  signal  bandwidth.  Under  low  SNR  conditions  where  the  MF 


terms  dominate  the  ALE  output  noise. 


L  4  % 
opt 


1/a. 


For  higher  SNR 


where  the  WF  noise  component  contributes  significantly,  maximum  gain 


is  typically  achieved  for  a  filter  length  shorter  than  the  inverse  signal 
bandwidth.  The  major  effect  is  that  attempting  to  over-resolve  narrow¬ 


band  signals  by  increasing  L  eventually  degrades  ALE  gain  because  of 
larger  misadjustment  noise  at  the  output.  Although  these  results  relate 
specifically  to  applications  in  which  the  LMS  adaption  is  used  to  estimate 
WF  coefficients,  they  emphasize  the  importance  of  including  the  effects 
of  algorithm  misadjustment  noise  in  the  performance  analysis  of  real¬ 


time  adaptive  processors. 
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Because  of  the  inclusion  of  a  finite  bandwidth  parameter,  the 
approach  presented  in  this  paper  has  relevance  to  more  realistic  ALE 
scenarios  than  the  previously  reported  studies  for  sinusoidal  input 
signals  embedded  in  broadband  noise.  In  addition,  the  VVF  analysis 
developed  here  may  be  applied  to  a  larger  class  of  LPF  problems  such 
as  systems  identification  and  speech  enhancement.  In  applications  where 
LPF  coefficients  are  used  to  estimate  signal  parameters,  our  analysis 
indicates  that  distortions  in  both  amplitude  and  bandwidth  will  occur 
for  finite  bandwidth  signals.  The  results  presented  in  this  paper 
may  provide  a  method  for  modeling  this  distortion  for  the  transversal 
linear  prediction  filter. 


I 

i 

I 
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